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Face recognition has become one of the most important challenging 
problems in personal computer-human interaction, video observation, 
and biometric. Many algorithms have been developed in recent years. 
These algorithms are not sufficiently robust to address the complex images. 
Therefore, this paper proposes a soft computing algorithm based on face 
recognition. One of the most promising soft computing algorithms which is 
back-propagation artificial neural network (BP-ANN) has been proposed. 
The proposed BP-ANN has been developed to improve the performance of 
face recognition. The implementation of the developed BP-ANN has been 
achieved using the MATLAB environment. The developed BP-ANN requires 
supervised training to learn how to anticipate results from the desired data. 
The BP-ANN has been developed to recognize 10 persons. Ten images have 
been used for each person. Therefore, 100 images have been utilized to train 
the developed BP-ANN. In this research 50 images have been used for 


testing purpose. The results show that the developed BP-ANN has produced 
a success ratio of 82 %. 
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1. INTRODUCTION 

In the present networked world, the need to keep up the security of data and physical property is 
becoming increasingly essential and increasingly difficult. From time to time we find out about the crimes of 
credit cards extortion, breaking of the personal computer by hackers, or on the other hand security breaks in 
an organization or government building. Recently, technology becomes accessible to permit verification of 
genuine individual identity. This technology depends on a field called biometrics. Face recognition represents 
one of the few biometric techniques [1]. It aims to imitate one of the natural human capacities: perceiving 
characteristics of faces in different situations and connect them with the learning stored in their memory. It is 
a simple and direct task for peoples, however, it seems to be a challenging problem for computing systems 
because of the few natural factors such as face location, lighting condition, and the distance of face from the 
camera [2]. 

Many soft computing techniques have been mentioned in the literature [3-6]. A new discriminant 
face recognition methodology, which is based on principal component analysis algorithm (PCA) and adaptive 
neuro-fuzzy inference system (ANFIS) has been proposed in [7]. PCA has been used to extract the feature of 
facial image and decrease its dimensions; meanwhile, ANFIS has been used as a classifier for face 
recognition. However, the ANFIS is required a very long time for training. In [8], a face recognition system 
has been implemented based on random forest (RF) classifier and histograms of oriented gradients (HOG) 
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face descriptor. However, the increasing of the number of trees in the random forest will make the system 
slower. Meanwhile, support vector machine (SVM) based on chaotic particle swarm optimization (CPSO) 
algorithm using improved circle map has been implemented in [9]. However, trap in local minima is the main 
drawback of the particle swarm optimization. 

Therefore, to overcome these drawbacks one of the most algorithms of pattern recognition namely 
back-propagation artificial neural network (BP-ANN) has been used in this research to implement the face 
recognition system. The paper is organized as follows: Section 2 describes design of the proposed system. 
Viola-Jones algorithm has been presented in Section 3. Section 4 explains the back-propagation artificial 
neural network. The implementation of the proposed system is found in Section 5. The discussion of the 
results is presented in Section 6. Finally, the conclusion is drawn in Section 7. 


2. DESIGN OF THE PROPOSED SYSTEM 

The proposed human face recognition system is shown in Figure 1. It passes in five steps which are 
image acquisition, face detection, feature extraction, face recognition, and recognition report. 
Image acquisition phase represents the first stage of a face recognition system. Therefore, the user gives the 
face image as the input to the system. The next step required for facial recognition system is face detection. 
It is the process of deciding whether a sub-window of an input image contains a face or not. In this research, 
the detection of the face has been implemented using the Viola-Jones algorithm. The third phase is feature 
extraction from the face image. Principal component analysis (PCA) algorithm has been used to extract these 
features. It is one of the most famous algorithms of features extraction [10]. Regarding the fourth phase is 
face recognition. In this module, the system takes the face of an individual to be recognized and compare it 
with the faces that already trained in the neural network and it recognized the best matching face as output. 
For this purpose back-propagation artificial neural network (BP-ANN) algorithm has been used. Finally, 
the system classified the input face image as known or unknown person. 


Image Acquisition 
Face Detection 


Recognition Report 





Figure 1. The proposed human Face recognition system 


3. VIOLA-JONES ALGORITHM 

Viola-Jones algorithm is one of the most important and famous methods have been used to detect 
the human face from an entire image [11]. It is proposed in the year 2001 by Paul Viola and Michael Jones. 
The goal of this algorithm is the issue of face detection but can also be implemented for detecting diverse 
objects such as eyes, nose, and mouth [12]. This method contains four basic components as described in the 
following: 


3.1. Harr Features 
The essential part of this process is the extraction of Harr features from the image using Harr cascade 
classifier. Each feature restores a single value which is given by subtracting the sum of the pixels in the white 


area from the sum of pixels in the black area [13], as defined below: 


F(x) = = (pixels in black area) - & (pixels in white area) (1) 
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3.2. Integral Image 

To reduce the computational time, another image representation has been used called integral image 
[14]. The value of each (x, y) location in the integral image is the sum of pixels above and left of this location 
at the original image [15]. 


3.3. AdaBoost Algorithm 

Viola-Jones algorithm has been used a 24x24 window size as the base window to begin the extraction process 
of Harr features from any given image [15]. Thus, around 160000 features can be extracted by using this 
window which is practically impossible [13]. For this reason, the AdaBoost algorithm has been used to find 
the best features among 160000. These features represent the weak classifiers. The AdaBoost algorithm 
creates strong classifiers as a linear combination of these weighted weak classifiers as shown below [15]: 


F(x) = aifi(x) + azfo(x) + a3f3(x)+...... (2) 


Where F(x) represents the strong classifier, while f1(x), f2(x) and so on represents weak classifiers, a1,a2 and 
so on are weighted quantities and x is an image [16]. 


3.4. Cascade Classifier 

Cascade classifier is a method for combining strong classifiers created by AdaBoost algorithm in 
cascade stages. These stages have been used to determine whether the sub-window for the given image is a 
face or non-face [17]. 


4. BACK-PROPAGATION ARTIFICIAL NEURAL NETWORK 

Artificial neural network (ANN) is an information processing tool that is inspired by the way the 
human brain work principle [18]. It is composed of a large number of interconnected processing neurons. 
Back-propagation artificial neural network (BP-ANN) represents one of the most commonly used families of 
neural networks for pattern recognition due to its relative simplicity [19]. It based on gradient descent to 
update the weights in order to reduce the squared error between the output and target values of the network 
[20]. BP-ANN is a multilayer feedforward, supervised learning network. It goes in both directions forward 
and backward. In the forward direction, training data is fed to the neural network through the input layer. 
Then data is applied to the hidden layer, the processing of data is actually performed at the hidden layer. 
Then, the data is applied to the output layer. The output calculated in the forward direction is compared with 
the target output. The difference between the target output and the calculated output provide the error. 
This error is calculated and propagated back towards the lower layer of the network for updating the weights 
of each layer to minimize it [21]. This error is given by the mean square error (MSE) as defined below: 


MSE =~Y2,(T; — ¥;)? (3) 


Where T; is the target output of the network, Y; represent the calculated output, and n is the number of the 
network samples [22]. 


5. IMPLEMENTATION OF THE PROPOSED SYSTEM 

The system for human face recognition involves four stages. These stages are the pre-processing 
stage, training stage, implementation of back-propagation artificial neural network and testing stage. 
These stages will describe in the next sections. 


5.1. Pre-processing Stage 

In this stage, the Viola-Jones algorithm has been used to detect the face region from an entire image, 
which is referred to as a face detection process. Then, the PCA algorithm has been used to extract the main 
important features from the detected face image. Therefore, in this work, each face image is represented by 
100x1 feature vector. Here, databases of 100 face images have been used with different faces of 10 persons. 
As a result, 100x100 database has been used for training the neural network. A robust and efficient face 
recognition system should be insensitive to noise generated by cameras or frame grabbers. For this reason, 
it is very important to add noise to some image face samples for each person that already been stored in the 
face database. 
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5.2. Training Stage 

As described earlier during the pre-processing stage, the feature vectors for face images are 
computed to train the neural network. MATLAB environment has been used to implement a physical feed 
forward back-propagation neural network. 


5.3. Implementation of Back-Propagation Artificial Neural Network 
The proposed architecture of BP-ANN model for proposed face recognition system is shown in 
Figure 2. It contains four layers; input layer, two hidden layers, and output layer. 


Input layer Hidden layer Hidden layer Output layer 





Figure 2.The architecture of the develop ANN 


The input layer represents the image of the face as a system input. Therefore, the number of neurons 
in the input layer depends on the dimensions of an image which in this work is equal to 100 neurons. In the 
artificial neural network, two variables have been considered namely learning rate and the number of hidden 
neurons. The range value of the learning rate is greater than 0 and equal to or less than 1. Three values of the 
learning rate which are 0.2, 0.4, and 0.8 have been tested in the training of ANN to determine the appropriate 
learning rate value. The ANN with a learning rate of 0.4 gives the most accurate results. Regarding the hidden 
layer, the ANN was trained using 25, 55, and 85 neurons. The appropriate neurons have been found to be 55 
neurons for both hidden layers. The hidden neurons perform the calculation using bipolar sigmoid activation 
function as defined below: 


Zing = [doy | + b; where j=1,2,....., 55 (4) 


Z; = — — 1 where j=1,2,....., 55 (3) 


1+e 


The last layer is the output layer. The number of neurons in the output layer depends on the nature of 
the problem. The developed system has been proposed for 10 persons. To decrease the neurons in the output 
layer, a look up table has been used. Therefore, only four neurons have been used in the output layer. 
The look up table is shown in Table 1. 


Table 1. Lookup Table for the Proposed Persons 








Target Person Yi Y2 Y3 Y4 
Dima 0 0 0 0 
Abdulazeez 0 0 0 1 
Mohammed 0 0 1 0 
Reem 0 0 1 1 
Mostafa 0 1 0 0 
Jumana 0 1 0 1 
Teeba 0 1 1 0 
Ibraheem 0 ! 1 1 
Rania | 0 0 0 
Hala 1 0 0 1 
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The bipolar sigmoid activation faction has been used to perform the calculation in the output layer as 
defined below: 


Yeac= (2 fa 2jjx| + by where k=1,2,3,4 (6) 


XY, = — 1 where k=1,2,3,4 (7) 


te Yink 
5.4. Testing Stage 

This stage is used to evaluate the performance of the proposed face recognition system. In this 
research 50 images have been used for testing purpose. The selected testing image is given to the trained 
neural network. Then, this image is compared with the face images of the trained neural network. Therefore, 
it recognized the best matching face as output. 


6. RESULTS AND DISCUSSION 

In this paper, a human face recognition system has been implemented. The face recognition system 
consisted of two main parts. The first part is the detection process of the face from an entire image. 
This purpose has been achieved using the most important face detection method called the Viola-Jones 
algorithm. The second part represents the recognition of the face. BP-ANN has been implemented for this 
purpose. In the training of ANN, two parameters must be adjusted, namely, learning rate and the number of 
neurons in the hidden layer. The appropriate value of the learning rate is 0.4; meanwhile, the appropriate 
value of neurons in both hidden layers are 55 neurons. The MSE values are then averaged from the training 
results. Figure 3 shows the number of epochs against the MSE which is 1.4143E-5. After the ANN is trained, 
it can be used for on-line human face recognition. 
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Figure 3. (a) Performance curve with respect to MSE, (b) Regression plot of training data 


The detection and recognition process has been achieved using the graphical user interface (GUI) of 
the MATLAB environment. 50 images have been subjected for testing purpose. BP-ANN succeeded in 
recognized 41 images. Meanwhile, failed to recognized 9 images. The sample of the recognized image is 
shown in Figure 4. 








Load Image Detected Face 


Recognized Person Weicom Reem 








Figure 4. Sample of face recognition using neural network 
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The ANN has been subjected to 50 images as mentioned before. Some of these images are not in the 
ANN database. Therefore, the ANN succeed to recognize these images. Sample of the not recognize persons 
is shown in Figure 5. 








Load Image Detected Face 


Recognized Person Sorry Person not Found 








Figure 5. Sample of face not recognition using neural network 


After all images were subjected to ANN, the success recognition ratio has been found to be 82%. 
Meanwhile, the failed ratio has been found to be 18%. The graphical representation of results can be shown in 
Figure 6. The figure shows that the ANN has been achieved acceptable results. Therefore, the ANN can be 
used for face recognition. 
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Figure 6. Performance representation of back-propagation neural network 


7. CONCLUSION 

Today, face recognition system play an important role in many applications such as authentication, 
indexing, monitoring, and other surveillance applications. In this paper, one of the most common soft 
computing algorithms which is the BP-ANN has been proposed for face recognition. The appropriate values 
of the learning rate and neurons in the two hidden layers have been found to be 0.4, 55, and 55 respectively. 
Therefore, the ANN has been developed with 100-55-55-4 architecture. The performance evaluation has been 
achieved under the MATLAB environment. 50 images have been used for testing purpose. The ANN 
succeeds to recognize 41 images and fail to recognize 9 images. Therefore, the success ratio is 82 % 
meanwhile; the failed ratio is 18%. Through testing results of the experiment, this system achieves a higher 
recognition rate. Therefore, good results can be achieved using the developed BP-ANN. Furthermore, the BP- 
ANN algorithm is fast and relative simple to implement. 
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